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Abstract 

The  subject  of  this  paper  is  the  heavy  traffic  behavior  of  a  general  class  of  queueing  networks 
with  first-in-first-out  (FIFO)  service  discipline.  For  special  cases  which  require  various  as- 
sumptions on  the  network  structure,  several  authors  have  proved  heavy  traffic  limit  theorems 
to  justify  the  approximation  of  queueing  networks  by  reflected  Brownian  motions  (RBM's). 
Based  on  these  theorems,  some  have  conjectured  that  the  Brownian  approximation  may  in  fact 
be  valid  for  a  more  general  class  of  queueing  networks. 

In  this  paper,  we  prove  that  the  Brownian  approximation  does  not  hold  for  such  a  general 
class  of  networks.  Our  findings  suggest  that  studying  Brownian  models  of  non-FIFO  queueing 
networks  may  perhaps  be  more  fruitful. 
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1      Introduction 

The  past  few  years  have  witnessed  a  surge  in  research  activities  dealing  with  Brovvnian  ap- 
proximations of  queueing  networks  [3,  5,  7,  10,  15,  16].  This  line  of  research  suggests  that 
certain  processes  associated  with  a  queueing  network  can  be  approximated  by  reflected  Brow- 
nian  motions  (RBM's),  and  these  approximations  are  justified  by  so  called  "heavy  traffic  limit 
theorems."  Although  such  limit  theorems  have  been  proved  only  for  special  cases  which  require 
various  assumptions  on  the  network  structure,  some  authors  have  proposed  that  the  Brownian 
approximations  in  fact  may  be  used  for  a  more  general  class  of  networks  that  operate  under 
the  first-in-first-out  service  discipline  [15,  16]. 

In  this  paper,  we  prove  that  the  Brownian  approximation  is  not  valid  for  such  a  general 
class  of  networks.  We  do  so  by  proving  a  "pseudo"  heavy  traffic  limit  theorem,  which  states 
that  if  the  process  associated  with  the  queueing  network  converges  to  a  continuous  limit,  then 
that  limit  must  be  the  RBM  specified  by  the  Brownian  approximation.  We  then  present  a 
queueing  network  example  developed  by  Dai  and  Wang  [11]  for  which  the  specified  Brownian 
approximation  is  not  well  defined.  Our  findings  suggest  that  it  may  be  fruitful  to  consider 
a  more  general  class  of  approximating  processes.  Furthermore,  our  findings  signal  that  other 
service  disciplines  may  yield  more  tractable  structures. 

We  consider  a  network  composed  of  d  single  server  stations,  which  we  index  by  j  =  1, .  . .  ,  tf. 
The  network  is  populated  by  c  classes  of  customers,  and  each  class  k  has  its  own  exogenous 
renewal  arrival  process  E^  =  {Ek{t),t  >  0}  (possibly  null),  where  Ek(t)  is  the  number  of  class 
k  customers  who  arrive  at  the  network  by  time  t.  For  each  customer  class  k  =  l,...,c,  it 
is  assumed  that  £'^(0)  =  0  and  customer  inter-arrival  times  have  mean  l/a^  with  squared 
coefficient  of  variation  (SCV)  c^  ^.  (The  SCV  of  a  random  variable  is  defined  as  its  variance 
divided  by  the  square  of  its  mean.)  We  denote  by  E  the  c-dimensional  process  with  components 
Ei,...,Ec-  (All  vectors  are  envisioned  as  column  vectors.)  We  assume  that  arrival  processes 
El,  . . .,  Ec  are  independent  and  a^  >  0  for  at  least  one  k.  For  each  k,  ak  is  interpreted  as  the 
long-run  average  arrival  rate  for  class  k  customers.  These  customers  require  service  at  station 
s{k),  and  their  service  times  are  independent  and  identically  distributed  (i.i.d.)  with  mean  m/t 
and  SCV  c^  1^.  The  service  time  sequences  for  the  various  customer  classes  are  independent  of 
one  another  and  are  also  independent  of  the  arrival  processes.  Upon  completion  of  service  at 
station  s{k),  a  class  k  customer  becomes  a  customer  of  class  /  with  probability  P^i  and  exits 
the  network  with  probability  1  —  ^;  Pki,  independent  of  all  previous  history.  The  transition 
matrix  P  =  (Pjt/)  is  taken  to  be  transient,  which  simply  means  that  all  customers  eventually 
leave  the  network.  Hence  the  networks  we  are  considering  are  open  queueing  networks.  We 
assume  that  the  waiting  buffer  at  each  station  has  infinite  capacity,  and  that  customers  are 
served  at  each  station  on  a  first-in-first-out  (FIFO)  basis.  Hereafter,  we  will  refer  to  such  a 
network  as  a  multiclass  open  queueing  network. 

Such  a  description  of  a  multiclass  network  is  now  quite  standard,  as  in  Harrison  and 
Nguyen  [15,  16].  (The  class  of  queueing  networks  described  here  is  in  fact  an  important  special 
case  of  the  setup  in  [15,  16].)  Figure  1  shows  an  example  of  such  a  network,  which  Dai  and 
Wang  [11]  have  studied.  Customers  arrive  at  station  1  according  to  a  Poisson  process  with  rate 
ai  =  1.  Each  customer  follows  a  deterministic  route  whose  sequence  of  station  visitations  is 
1,  1,  2,  2,  1,  after  which  the  customer  departs  from  the  network.  Hence,  each  customer  makes 
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5  stops  before  exiting  the  network,  and  we  designate  those  customers  in  their  Ic'-^  stop  as  class 
k  customers. 

In  his  pioneering  paper  on  queueing  networks,  Jackson  [22]  assumed  that  customers  visiting 
or  occupying  any  given  station  are  essentially  indistinguishable  from  one  another,  and  that  a 
customer  completing  service  at  station  i  will  move  next  to  station  j  with  some  fixed  probability 
P,j,  independent  of  all  previous  history.  Thus  in  Jackson's  networks,  each  station  serves  a  single 
customer  class,  hence  these  networks  have  been  called  single-class  networks.  Jackson's  model 
was  extended  by  Baskett  et  al.  [1]  and  Kelly  [24]  to  networks  populated  by  multiple  types  of 
customers,  each  type  following  a  deterministic  route.  The  routing  mechanism  described  in  this 
paper  subsumes  those  considered  in  [1,  24].  Readers  are  referred  to  Harrison  [14]  and  Harrison 
and  Nguyen  [15,  16]  for  further  discussion. 

For  each  j  =  \, .  .  .  ,d  and  each  <  >  0,  let  Wj{t)  denote  the  sum  of  the  impending  service 
times  for  all  customers  who  are  queued  at  station  j  at  time  /,  plus  the  remaining  service  time 
for  any  customer  who  may  be  in  service  there  at  time  t.  If  a  new  customer  arrives  to  station 
_;'  at  time  t,  that  customer  must  wait  Wj{t)  time  units  before  gaining  access  to  the  server,  so 
one  can  also  describe  Wj{t)  as  the  virtual  waiting  time  process  for  station  j.  Set  W{t)  to  be 
the  d-vector  with  components  W\{t),  ...,  Wd{t).  Define  the  process  Wj  —  {W]{t),t  >  0}  and 
let  W  be  the  corresponding  c/-dimensional  workload  process  defined  in  the  natural  way. 

Intuitively,  when  the  system  is  heavily  loaded,  the  workload  \V(t)  at  time  t  will  be  large  for 
large  t.  Let  pj  be  the  traffic  intensity  at  station  j  (this  term  will  be  be  defined  in  Section  2). 
The  quantity  pj  can  also  be  interpreted  as  the  long-run  fraction  of  time  that  server  j  is  busy. 
As  an  example,  because  the  arrival  rate  is  set  to  be  1,  the  traffic  intensities  for  the  network 
pictured  in  Figure  1  are  given  by  p\  =  m\  +  m2  +  m^  and  p2  =  '^3  +  "^4.  To  facilitate  our 
explanation  of  the  underlying  concepts,  let  us  for  the  moment  assume  that 


1.11 


P:  =  1,      J  =  1. 


Condition  (1.1)  is  a  special  form  of  the  heavy  traffic  condition  as  described  in  Section  2.   For 
fixed  f  >  0,  we  are  interested  in  how  fast  W{nt)  goes  to  infinity  as  n  —  00.  It  has  been  widely 
believed  that 
(1.2)  W'^it)  =  -^W{nt)  =^  W'{t) 


W-(t)  =  ^W(nt) 
v/n 


as  n  — 'CO, 


where  W  =  {W'{t),t  >  0}  is  a  d-dimensional  semimartingale  reflecting  Brownian  motion 
(SRBM)  and  the  symbol  "=>"  denotes  weak  convergence  (the  notion  of  weak  convergence 
will  be  clarified  in  Section  2).  Our  main  contribution  in  this  paper  is  the  proof  that  conjecture 
(1.2)  does  not  hold  in  general. 
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Figure  1:  A  two-station  network  with  self-feedback 


QNET  Method  for  Performance  Analysis 

Exact  analysis  of  a  multiclass  network  models  is  limited  essentially  to  networks  whose  mter- 
arrival  times  have  exponential  distributions  and  whose  service  times  for  all  customers  at  each 
station  have  the  same  exponential  distributions  (cf.  Baskett  et  al.  [1]).  Such  networks  are 
commonly  referred  to  as  BCMP  or  Kelly  networks.  For  networks  with  other  distributional 
forms,  no  exact  formulae  are  available  to  facilitate  the  analysis. 

In  recent  years,  a  promising  new  approximation  scheme,  known  as  the  QNET  method,  has 
been  proposed.  The  first  step  in  a  QNET  analysis  is  to  replace  one's  "exact"  queueing  model  by 
an  approximating  Brownian  model,  see  Harrison  and  Nguyen  [15,  16].  The  second  step  involves 
steady-state  analysis  of  the  approximating  Brownian  model;  see  Harrison  and  Williams  [18], 
Dai  and  Harrison  [7]  and  Dai  and  Kurtz  [8].  For  a  queueing  network  with  d  stations,  this 
analysis  requires  that  one  determines  the  stationary  distribution  of  a  d-dimensional  reflecting 
Brownian  motion.  Finally,  summary  statistics  derived  from  that  stationary  distribution  are 
used  to  obtain  approximate  steady-state  performance  measures  for  the  original  systems.  Unlike 
previous  approximations,  the  Brownian  approximations  culminate  in  estimates  of  complete 
distributions;  readers  can  find  examples  of  Brownian  estimates  for  complete  sojourn  time 
distributions  in  Harrison  and  Nguyen  [16].  Readers  are  referred  to  Harrison  and  Nguyen  [15, 
16],  Dai  and  Harrison  [6,  7]  and  Dai,  Nguyen  and  Reiman  [10]  for  more  discussion  on  the 
QNET  method,  as  well  as  its  accuracy  and  efficiency.  Those  interested  in  the  QNET  software 
package  can  send  an  email  message  to  dai@isye.gatech.edu. 

Heavy  Traffic  Limit  Theorems 

In  cases  where  (1.2)  hold,  the  corresponding  theorem  is  called  a  "heavy  traffic  limit  theorem." 
There  now  exists  a  variety  of  heavy  traffic  limit  theorems  for  networks  with  certain  special 
structures.  The  first  heavy  traffic  limit  theorem  for  networks  of  queues  is  due  to  Iglehart  and 
Whitt  [20,  21],  who  worked  with  smgle-class  queues  in  series.  For  single-class  networks  whose 
routing  structure  is  similar  to  that  of  Jackson's  networks,  but  whose  inter-arrival  times  and 
service  times  may  have  general  distributions,  Reiman  [26]  proved  that  under  the  heavy  traf- 
fic condition,  the  normalized  queue  length  process  converges  weakly  to  a  reflecting  Brownian 
motion  (RBM).  The  definition  of  an  RBM  was  first  presented  in  Harrison  and  Reiman  [17]. 
Reiman's  proof  was  later  simplified  by  Johnson  [23].  Reiman 's  result  has  been  extended  by 
Chen  and  Shanthikumar  [5]  to  networks  in  which  stations  may  have  multiple  servers.  Peter- 
son [25]  proved  an  analogous  heavy  traffic  limit  theorem  for  multiclass  feedforward  networks. 
The  term  "feedforward"  denotes  a  routing  structure  in  which  stations  can  be  numbered  so  that 
customers  always  travel  from  lower  numbered  stations  to  higher  numbered  ones.  Reiman  [27] 
proved  a  heavy  traffic  limit  theorem  for  a  multiclass  one  station  feedback  queue.  Dai  and 
Kurtz  [9]  have  greatly  simplified  Reiman's  proof.  A  heavy  traffic  limit  theorem  for  single-class 
closed  networks  was  proved  by  Chen  and  Mandelbaum  [3].  Strong  approximations  for  single 
clciss  networks  were  discussed  in  Glynn  and  Whitt  [13]  and  Chen  and  Mandelbaum  [4]. 

Until  recently,  it  was  believed  that  a  heavy  limit  theorem  should  hold  for  multiclass  open 
queueing  networks  of  the  type  described  in  this  section.  Based  on  existing  heavy  traffic  limit 
theorems,   Harrison  and   Nguyen   [15,   16]  proposed  Brownian  models  to  approximate  these 


networks.  Unfortunately,  Dai  and  Wang  [11]  have  found  two-station  and  three-station  networks 
for  which  Harrison  and  Nguyen's  Brownian  models  fail  to  exist.  (A  more  explicit  interesting 
example  showing  no  convergence  was  given  by  Whitt  [30],  in  which  he  discovered  chaotic 
behavior  for  certain  multiclass  open  queueing  networks.)  Building  on  Dai  and  Wang  s  example, 
we  prove  in  this  paper  the  following  general  result:  There  exist  multiclass  open  queueing 
networks  for  whicli  the  scaled  workload  process  \V"(t)  does  not  converge  to  any  continuous 
limits.  A  by-product  of  our  result  is  that  if  the  normalized  workload  process  converges  to  a 
continuous  limiting  process,  that  process  must  be  the  reflected  Brownian  motion  identified  by 
Harrison  and  Nguyen. 

Organization  of  the  Paper 

We  introduce  some  additional  notation  and  definitions  in  Section  2.  In  Section  3,  we  state  the 
heavy  traffic  conjecture  and  the  main  theorem  of  this  paper.  We  prove  our  theorem  by  way  of 
a  "pseudo  heavy  traffic  limit  theorem,"  which  we  state  and  justify  in  Section  4.  The  proof  of 
our  main  theorem  is  in  Section  5.  Finally,  we  discuss  some  open  problems  in  Section  6. 

2      Preliminaries 

We  now  define  several  processes  that  will  be  used  later  in  later  sections.  Let  {<?l)^"(l),  o'^(2), .  .  .} 
be  a  sequence  of  i.i.d.  routing  vectors  for  class  it  customers.  The  Z'*^  component  of  the  vector 
0  (i)  equals  1  if  the  i'  class  k  customer  next  goes  to  class  /,  and  all  other  components  are 
zero.  Also,  define  the  c-dimensional  cumulative  sum  processes 

(2.1)  <j'=(r)  =  0*^(1) -H...  +  /(r). 

Finally,  set  C{j)  to  be  the  set  of  all  customer  classes  k  that  receive  service  at  station  _;',  that 
is,  CO)  =  {k  :  s(k)  =  j).  This  set  is  called  the  constituency  of  server  _;  in  Harrison  [14].   We 

require  that  C{j)  be  nonempty  for  each  j  =  1 d. 

Next,  set  C  to  be  the  d  x  c  incidence  matrix  with  components 

(2.2)  C,,  =  i    ^     'ftGCO), 

I    0     otherwise. 

Recall  that  Ek{t)  is  the  external  arrival  process  for  class  k.  Denote  by  Ak{t)  the  total  number 
of  customer  visits  to  class  it  by  time  t  and  by  Dk(t)  the  total  number  of  customer  departures 
from  class  k  by  time  t.  Letting  Fk{t)  denote  the  number  of  visits  to  class  it  by  time  t  that 
result  from  internal  transitions,  one  has  as  a  matter  of  definition 

C 

(2-3)  Ak{t)^  Ek{t)  +  Fk(t)^  Ek(t)  +  J2'^'k(D,(t)). 

1=1 

Let  {vk{l),Vk('2), .  .  .}  be  a  sequence  of  i.i.d.  service  times  associated  with  class  k  customers, 
and  let  Vfc(r)  be  the  cumulative  sum  process  defined  by 


We  denote  by  V{A{t))  the  c-dimensional  process  whose  t'^  component  is  given  by  rt(.4i.(0). 
and  we  set 

(2.4)  L(t)  =  CV(A(t)). 

Note  that  L  =  {L{t),t  >  0}  is  a  cf-dimensionai  process;  one  interprets  Lj{t)  as  the  amount  of 
work  for  server  j  brought  by  ail  those  customers  who  have  arrived  at  station  j  by  time  t.  The 
process  Lj  was  referred  to  as  the  immediate  workload  input  process  for  station  j  by  Harrison 
and  Nguyen  [16]. 

Let  Yj{t)  be  the  amount  of  cumulative  idleness  experienced  by  server  j  up  to  time  t  and 
let  Y{t)  =  (Vi(0,  ■  •  •  -^'(i(<))'  be  the  corresponding  vector  process.  (Prime  denotes  transpose.) 
We  can  express  the  d-dimensional  workload  process  W  =  {lV{t),t  >  0}  as  follows: 

(2.5)  W{t)^Lit)-te  +  Y{t), 

where  e  is  the  d-dimensional  vector  of  ones.  Clearly,  the  idleness  process  Vj()  may  increase 
only  at  times  t  such  that  Wj(t)  =  0,  hence 

(2.6)  Yj{t)  =  -    mf  {Lj{s)-s),      j  =  l,...,d. 

To  finish  our  description  of  the  network  model,  let  us  define  the  fundamental  matrix 

(2.7)  Q  =  (/-P')-i  =(/+P  4- P^ +  ...)'. 

The  {k,  /)'^  element  of  Q  represents  the  expected  number  of  visits  to  class  k  made  by  a  customer 
who  starts  in  class  /.  Thus,  defining  A  =  {\\, . . . ,  A^)'  via 

(2.8)  A  =  Qa, 

one  recognizes  that  \k  is  the  long-run  average  number  of  customer  visits  to  class  k  per  unit 
time  (resulting  from  external  arrivals  as  well  as  internal  transitions).  The  total  traffic  intensity 
at  station  j  is  then  defined  by 

(2.9)  p,=    Y.    ^krrik. 

kecu) 

Let  p  be  the  vector  of  traffic  intensities  at  stations  I,. . .  ,d.  One  can  express  the  vector  of 
traffic  intensities  in  matrix  form  via 

(2.10)  p  =  CMX, 

where  M  is  the  c  x  c  diagonal  matrix  with  diagonal  elements  mj, .  . . ,  m^. 

To  rigorously  state  our  convergence  result,  we  need  to  introduce  the  path  space  D'^[0,oo), 
which  is  the  space  all  functions  /  :  [0,oo)  —  R'^  which  are  right  continuous  on  [0,oo)  and 
have  finite  left  limits  on  (0,oo).  The  path  space  D'^[0.oo)  is  endowed  with  the  Skorohod 
topology,  see  Billingsley  [2].  For  a  sequence  {^"}  of  D'^fO,  cxd)- valued  stochastic  processes  and 
X  e  D''[0,oo),  we  write  A:"(-)  =>  A'()  if  JV"  converges  to  X  in  distribution. 

For  a  function  /  :  [0,  oo)  —  R  and  t  >  0,  put 

,  =   sup   |/(s)|, 

0<3<« 


and  for  a  vector  of  functions  /  =  (/i ,  ■  ■    ,  A)'  :  [0,  oo)  -~  R*^  and  t  >  0.  put 

l<-(ll/iil< IIAII*)'. 


A  sequence  {/"}  of  functions  /"  :  [0,oo)  —  R  is  said  to  converge  uniformly  on  compact 
(u.o.c.)  sets  to  /  :  [0,'3c)  —  H^  if  for  each  t  >  0,  ||/"  -  f\\t  ^  0  as  n  —  x;.  For  a  sequence 
{X"}  of  D'^[0.  oo)- valued  stochastic  processes  and  X  G  D'^[0,  oo)  defined  on  a  probability  space, 
we  write  X"()  —  .V()  u.o.c.  if  almost  surely,  A'"  converges  to  A'  uniformly  on  compact  sets. 

3      Conjecture  and  the  Main  Theorem 

In  order  to  rigorously  state  a  heavy  traffic  limit  theorem,  we  need  to  consider  a  "sequence 
of  networks"  indexed  by  n.  Our  setup  here  follows  closely  that  of  Harrison  and  Nguyen  [16]. 
Let  a"  and  m"  be  vectors  of  inter-arrival  rates  and  service  times,  respectively,  associated  with 
the  n'  network  in  the  sequence.  We  may  assume  without  loss  of  generality,  however,  that  the 
routing  matrix  and  the  squared  coefficients  of  variation  for  inter-arrival  times  and  service  times 
remain  fixed  across  the  sequence  of  networks.  Define  p"  to  be  the  vector  of  traffic  intensities 
for  the  n'-^  matrix  similarly  to  (2.9).  We  are  interested  in  the  sequence  of  networks  such  that 

(3.1)  a"^a,      m"  — m>0, 

and 

(3.2)  ^{p^  -e)~  (3,      asn  — oo, 

where  e,  as  before,  is  the  vector  of  ones.  Condition  (32)  requires  that  p"  —  1  at  an  appropriate 
rate,  and  is  known  as  the  heavy  traffic  condition.  As  n  ^  oo,  we  are  interested  in  the  limit  of 
the  normalized  workload  process  W^  defined  by 

(3.3)  rV"(<)  =  -^Wint),      t  >  0. 

Before  we  state  the  conjecture,  we  define  more  scaled  processes.  For  each  t  >  0  and  n  >  1. 
set 

V" 
K"(^)     =     ^(V'"(M)-m"n<), 


1.^(0     =     -^{n{[nt])-P:knt),      1=1, 


,c,  k  =  l,...,c, 


where  [x]  is  the  integer  part  of  x.   (Again,  note  that  the  processes  <!>'  do  not  change  with  n  ) 
It  follows  from  the  classical  Donsker  theorem  that  as  n  —  oo 

(3.4) 
(3.5) 
(3.6)  (!>••"  =>^',      ,-=1, 


£" 

=^C, 

1/" 

^r, 

$••' 

^=>r 

where  ^'',  ^^  and  4'  ('  =  1, .  •  ,c)  are  (c  +  2)  independent  c-dimensional  zero-drift  Brovvnian 
motions  with  covariance  matrices  F",  F'  and  F'  (;  =  1, . . .  ,c),  respectively.  It  is  easily  verified 
that  F"  =  diag(aic^j, . . . ,  accl^),  F'  =  diag(m^c^  j "^fcC^,,-)  and  F'  is  a  matrix  defined  by 

.    ^   r    P.fc(l-P,fc)     i{k  =  l 

Because  Brownian  motions  are  continuous  and  £",  V"*,  <!>''"  (i  =  1,  . .  .  ,  c)  are  independent,  we 
can  and  will  assume  by  the  Skorohod  representation  theorem  that  the  convergence  in  (3.4)- 

(3.6)  holds  u.o.c. 

Conjecture  1  Under  the  heavy  traffic  conditions  {3.l)-{'i.2),  the  sequence  of  normalized  work- 
load processes  W"-  defined  in  (33)  converges  to  a  continuous  process  W  —  {W'{t),t  >  0} 
uniformly  on  compact  sets  as  n  — •  cxd.    That  is 

(3.7)  -=W''{nt)  ~W'{t),      u.o.c,  as  n —  oo. 


Theorem  3.1  There  exist  multiclass  open  queueing  networks  for  vohich  the  scaled  workload 
process  W"'  does  not  converge  to  any  continuous  limit.   In  particular,  Conjecture  1  is  false. 

The  key  to  the  proof  of  Theorem  3.1  is  the  "pseudo"  heavy  traffic  result  stated  in  Theorem  4.1 
and  proved  in  the  next  section  together  with  the  Dai- Wang  example  in  [11].  We  leave  the  proof 
of  Theorem  3.1  to  Section  5. 

Corollary  3.1  If  the  conclusion  m  conjecture  1  is  changed  to  {lV'",n  >  1}  being  D-tighi.  the 
conjecture  is  still  false. 

The  definition  of  tightness  is  given  in,  for  example,  Section  3.2  of  Ethier  and  Kurtz  [12].  The 
proof  of  the  corollary  is  given  at  the  end  of  Section  5. 

4      A  Pseudo  Heavy  Traffic  Limit  Theorem 

Set 

G  =  CMQP'AC, 

where  M  =  diag(mi, . . . ,  m,.)  and  A  =  diag(A),  and  diag(A)  is  the  diagonal  matrix  with 
diagonal  elements  Ai,  . . . ,  A^.  Recall  that  Yp{t)  is  the  cumulative  idleness  of  server  j  by  time 
t  for  the  n'^  system,  and  Y"{t)  is  the  d-dimensional  vector  with  components  V",  . . .  ,  VJ*.  Set 

Theorem  4.1  Assume  Conjecture  1  is  true,  namely,  that  the  convergence  in  (3.7)  holds.  Then 
the  sequence  of  normalized  idleness  process  Y^  converges  to  Y'  u.o.c.   and  the  limiting  processes 


{W',Y')  must  satisfy 

(4.1)  (/  +  G)w'(t)  =  cr(Ao  +  c.\[Q  Icit)  +  E  ^^■('^^•oj  +  -^^  +  y'it). 

(4.2)  W'{t)  >  0, 

(4.3)  y  "(0)  =  0,   V  !s  continuous  and  nondecreasing, 

(4.4)  yj'()  increases  only  at  times  t  such  thai  W'{t)  =  0.  j  =  I d. 

Remark.  Theorem  4.1  states  that  if  (3.7)  is  true,  then  the  Brownian  model  proposed  by 
Harrison  and  Nguyen  [15,  16]  is  the  correct  model.  Harrison  and  Nguyen  summarily  referred 
to  this  result  (namely,  the  pseudo  proof)  in  Section  5  of  [16].  We  offer  a  complete  proof  in  this 
paper  and  consequently  use  this  theorem  to  prove  Theorem  3.1  in  Section  5. 

The  remainder  of  this  section  is  devoted  to  proving  Theorem  4.1.  We  begin  by  introducing 
some  important  notation.  For  j  =  1,.  .  .  ,ci  and  t  >  0,  define  T^{t)  to  be  the  arrival  time  to 
station  j  of  the  customer  currently  being  serviced  there  if  ^'^"(O  >  0,  and  to  be  i  if  lV"(f)  =  0. 
Let  r"(<)  be  the  d-dimensional  vector  defined  in  the  obvious  manner.  This  definition  of  r"-{t), 
which  is  slightly  different  from  what  was  given  in  Peterson  [25,  page  103],  enables  us  to  give 
a  concise  proof  of  Lemma  4.2  below.  With  r"(<),  one  can  verify  that  the  number  of  class  k 
customers  to  have  departed  from  station  j  =  s{k)  by  time  /  is  given  by 

(A  ^\      n^(i\  —  J    "'^!t(''7('))  ~  ^'      if  server  j  is  currently  serving  a  class  k  customer. 
^  *:n  -  I    4n(^n(,)j^  Otherwise. 

We  will  use  /l"(r"(<))  to  denote  the  c-dimensional  process  whose  /fc'*'  component  is  .-ifc(T-^%.)(0)- 
For  each  t  >  0  and  n  >  1,  define 

f"«)  =  -T^'int),      f"(t)  =  -^{nt  -  r"(ni)), 

and 

A^it)  =  -.4"(nO,      .4"(0  =  4-  (.4"(nO  -  A"t) . 
n  ,/n 

The  first  two  lemmas  below  hold  in  general  without  the  assumption  of  convergence  in  (3.7). 
Lemma  4.1    For  each  sample  path  and  each  t  >0,  there  exists  k  independent  of  n  such  that 

Wki-)\\t<^,       t=l,...,c,       n>l. 

Proof.  Let  5j^  =  {Sk(t),t  >  0}  be  the  renewal  process  associated  with  class  k  service  times. 
Let  T^{t)  be  the  cumulative  time  that  server  s{k)  has  devoted  to  class  k  customers  in  t  units 
of  time.  Then,  the  number  of  class  k  customers  to  have  departed  from  station  s{k)  by  time  t 
is  D]^{t)  =  5?(T^"(t))  <  5n0    Therefore,  from  (2.3),  we  have 

c  c 

A'^it)  =  E^^it)  +  Y.  <j>'(5'n7r(0))  <  E^t)  +  Y.  ^\sm))- 
k=i  fc=i 

The  lemma  then  follows  from  the  functional  strong  law  of  large  numbers  for  random  walks  and 
renewal  processes.  □ 


From  the  definition  of  T^{t).  it  follows  that 

(4.6)  f  =  r;(o  +  iv7(r;(/))-.;(o. 

where  e"(0  is  0  if  \Vj^(t)  =  0,  and  otherwise  is  equal  to  the  remaining  service  time  of  the 
customer  currently  occupying  server  j.  Define  r"(t)  =  t  —  r^(t).  and  note  that 

PV';(r;(<))-€;(o  =  r;(o<ir;(r;(o). 

The  next  three  results  show  that  under  the  heavy  traffic  scaling,  the  processes  f^"(<)  and  W^{t) 
are  close  for  large  n.  We  begin  with  the  following  lemma,  which  proves  that  £"(/)  is  negligible 
under  the  heavy  traffic  scaling. 

Lemma  4.2   For  j  =  I, . . .  ,d, 

lim  —=i^{nt)  -~  0,      u.o.c.  as  n  —  :o. 
n—oo  ^n   ■' 

Proof.   It  follows  from  the  definition  of  e"(f )  that 

0  <  f"(<)  <   max      max      1^(1), 
~    •'  k^C{:)  \<,<A2(t) 

where  {vj(l),  vjf  (2), .  .  .}  is  the  sequence  of  i.i.d.  service  times  for  class  k  customers.  An  appli- 
cation of  Lemma  3.3  from  Iglehart  and  Whitt  [20]  yields 


v^'"<"' 


0. 


D. 


Lemma  4.3   Suppose  the  convergence  tn  (3.1)  holds.    Then 

f"(f)  — e<     u.o.c, 
where  e  is  the  d-dimensional  vector  of  ones. 
Proof.  Let  iy,"(t)  =  iPV"(nt).  Then, 

Kif"{t))  -  -^]{nt)  =  -T^int)  <  rv;(f;(t)), 


Because  t"{s)  <  s  for  s  >  0, 


1 


With  the  assumption  of  (3.7)  and  Lemma  4.2,  the  lemma  is  proved. 
Lemma  4.4   Suppose  the  convergence  in  (3-7)  holds.    Then, 

f"(0  —  W'*(<)     u.o.c.  as  n  —  00. 
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Proof.    Because 

w^ir^^it))  -  €^(t)  =  t  -  r;(f )  <  n-;(r;(o), 

we  have 

rv^;(f;(0)  -  ^s"("*)  =  ^;(0  <  K(f^{t)). 

The  lemma  follows  immediately  from  assumption  (37)  and  Lemmas  4.2  and  43.  □ 

Lemma  4.5  Suppose  the  convergence  tn  (3.7)  holds.    Then 

i"(<)  — A<     u.o.c. 
Proof.   It  follows  from  (23)  that 

C 

k=i 
where  E"(0  =  ^F"(nf),  £)"(/)  =  ^D^'int)  and  $''"•"(0  =  ]^4>^{[nt])  hv  /t  =  1 c.  Therefore. 

(4.7)  A''{t)-Xt     =     E'^(0-af  +  Xl(<l>''"(^,"(/))-P(D^(0) 

fc=i 
+  P'(D"(i)  -  AC'f"(<))  -  P'XC'ite  -  f"(<)), 

where  we  have  used  the  fact  that 

A  =  a+P'A, 

and  Pk  denotes  the  k^^  row  of  P.  Using  equation  (4.5),  we  can  replace  D"(<)  in  the  third 
expression  on  the  right  hand  side  of  (4.7)  by  ^"(f"(t))  when  n  is  large.  Hence,  by  Lemmas  4.1 
and  4.3  and  functional  strong  law  of  large  numbers,  we  have 

hmsupp"()-  A-  lit  <  limsupP'||/i"(r"())-  Af"(.)||(  <  P' limsup  ||.4"()  -  A  ■  ||(. 

n—^oo  n— oo  n— '>i 

Because  (/ -  P')-i  >  0, 

hmsup||^"()- A||(  <0, 

n— »oo 

and  hence 

lim  |L4"()- A-  ||(  =  0. 

n— ►oo 

D 
Lemma  4.6   Define  for  each  t  >  0, 

lit)  =  Q  Icit)  +  ^^*(AfcO  -  P'XC'W'it)]  . 

Suppose  the  convergence  in  (3.7)  holds.    Then 

.4"(<)  — ►  T]{t)     u.o.c,  as  n  —  oo. 
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Proof.    First,  note  that 

.4"(f)  =  £"(0  +  Yl  *^''"  (-■^fc(^.sU-)(0))  +  P'.4"(f"(0)  -  P'A"C"f"(0 
and 

c 

Thus, 

c 
*:  =  ! 

+  P'  (i"(f"(t))  -  r,(f"(0))  +  P'  (^(r"(0)  -  nm 
-  P'  (A"C'f"(0  -  kC'W'{i))  . 

Hence 

(4.8)     iii"(-)-'?(-)ii<  <  ii-^"(-)-r(-)iit  +  Eii<^''"(-^it(^r(fc)(-)))-^'(^/.-)ib 

+  P'||i"(r"(.))  -  r?(r"(-))||t  +  P'lh(r"(-))  -  r?(-)lh 
+  P'||A"C'f"(-)-AC'^V'*(-)ll(- 

Because  f"(s)  <  s  for  all  s  >  0  and  j  =  1, . .  . ,  d,  we  have 

IK(r"())-r?(r"(-))||f<IM"(-)-^(-)lk- 
Therefore,  it  follows  from  (4.8)  that 


(4.9)  (/  -  P')l|i"(-)  -  n{-)\\i    <    ll^"(-)  -  C(-)\\t  +  E  ll*^''"  (-^^(q^c)!-)))  -  ^'( A.«)||< 

fc=l 

+  P'^r^'i))  -  r7(-)||(  +  P'||A"C'f"(-)  -  AC'ir()||t 

=  at). 

Again,  note  that  Q  >  0.  Premultiplying  both  sides  of  (4.9)  by  Q,  we  have 

\\A"{)-rii)\\t<QC{t). 

Because  C"(^)  ~^  0.  ^^  have  proved  Lemma  4.6. 

Proof  of  Theorem  4.1.  To  prove  Theorem  4.1,  observe  that  from  (2.4)  and  (2.5), 

W'"(t)  =  CK"  (.4"(f ))  +  CM'^A'^it)  +  V^(p"  -  e)t  +  V'"(t). 

By  Lemmas  4.5  and  4.6  and  assumptions  (35)  and  (32),  we  have 

CV"  (i"(0)  +  CA/'*.4"(0  +  ,A(p"  -  e)t 

-  Cr  (AO  +  CA/Q  (r(0  +  E  ^''(^'tO  -  P'AC'Py  (o)  +  /?t 
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u.o.c.  as  n  — >  oo.  Because  the  mapping  defined  in  (2.6)  is  continuous.  Theorem  4.1  follows 
immediately  from  the  continuous  mapping  theorem.  D 

Remark.  Because  a  Brownian  motion  is  almost  surely  not  a  process  with  bounded  variation, 
the  matrix  I  +  G  must  be  nonsingular  in  order  for  a  solution  of  the  system  (4.1)-(4.4)  to  exist. 
Multiplying  both  sides  of  (4.1)  by  /?  =  (/  +  G)~' ,  one  has 

W'{t}  =  RCVi^i)  +  RCMQ  icit)  +  Y.  ^^AfcO )  +  R3t  +  RY'(t). 

For  each  f  >  0,  set 

X'{t)  =  RCei^t)  +  RCMQ  U" (0  +  Y.  ^''(^fcO)  +  R3t. 

Then  X'  is  a  Brownian  motion  with  drift  vector  6  =  R0  and  covariarice  matrix 


r-  =  Rc 


^^\  +  MQ  ( r''  +  ^  Atr'-' ]  q'm'  c'r' 


Without  worrying  about  the  adaptness  of  these  processes,  one  recognizes  that  W  is  a  semi- 
martingale  reflecting  Brownian  motion  (SRBM)  starting  from  zero  defined  by 

(4.10)  ,  W'it)  =  X'{t)  +  RY'{t),     <  >  0, 

and  (4.2)-(4.4)  with  covariance  matrix  T*,  drift  vector  6  and  reflection  matrix  R:  see  Reiman 
and  Williams  [28]  for  the  definition  of  an  SRBM.  Reiman  and  Williams  [28]  proved  that  if  an 
SRBM  exists,  the  matrix  R  must  be  completeiy-5.  In  particular,  the  diagonal  elements  of  R 
are  positive.  Conversely,  Taylor  and  Williams  [29]  proved  that  if  ft  is  a  completely-5  matrbc, 
then  the  corresponding  SRBM  exists  and  is  unique  in  law. 

5      Proof  of  Theorem  3.1 

Now  we  present  the  example  in  Dai  and  Wang  [11]  to  show  the  limiting  process  IV  in  Theo- 
rem 4.1  does  not  exist  for  certain  networks. 

Consider  the  two-station  network  pictured  in  Figure  1.  Customers  arrive  at  station  1 
according  to  a  Poisson  process  with  rate  q^*.  (The  index  n  indicates  the  n'*^  system.)  Each 
customer  makes  5  stops  before  departing  from  the  network,  and  the  stations  visited  are  in 
the  following  order:  1,  1,  2,  2,  1.  As  explained  in  Section  1,  we  designate  those  customers  in 
their  k  stop  as  class  k  customers.  The  service  times  for  class  k  customers  are  assumed  to  be 
exponentially  distributed  with  mean  mk  (k  =  1, .  . . ,  5),  independent  of  n. 

Choose  m  =  (1/10,  1/10,  22/27,  5/27,  8/10)'  and 


"^^(-Tt) 


Then  a"  —  1,  p"  <  e  for  each  n  and 

lim  v^(p"-e)  =  (-1,-1)'. 
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For  the  specific  data  above,  one  can  check  that  det(/  +  G)  =  0.  thus  I +  G  is  singular    Tlierefore. 
there  exists  a  vector  u  ^  0  such  that  u'{I  +  G)  =  0. 

Now,  assume  that  Conjecture  (37)  is  true.  By  Theorem  4.1,  the  normalized  workload 
process  and  idleness  process  (W'^,Y")  converges  to  the  limiting  processes  [W.Y')  u.o.c, 
where 

(5.1)  (/  +  G)W'{t)  =  .^(0  +  Jt  +  Y'{t), 

and  /  c  \ 

m  =  ccm  +  CMQ  lc{t)  +  Y,  etht)] 

is  a  Brownian  motion  with  zero  drift  and  covariance  matrix 

C 

r  =  cr  AC  +  CMQ{r^  +  Yi  Ajtr*)Q'MC'. 

Multiplying  both  sides  of  (5.1)  by  u',  we  get 

(5.2)  u'^(t)  =  -u'0t-  u'Y{t)^      for  alU  >  0. 

It  is  easy  to  check  that  F  is  a  positive  definite  matrLx  and  hence  u'^  is  a  zero  drift  Brownian 
motion  with  variance  uTu  >  0.  Note  that  the  left  hand  side  of  (5.2)  is  a  process  of  bounded 
variation,  while  a  Brownian  motion  is  almost  surely  not  a  process  of  bounded  variation.  There- 
fore the  conjecture  cannot  possibly  hold,  and  Theorem  3.1  is  proved.  Q 
Remark.   If  one  takes 

m  =  (1/10,1/10,23/27.4/27,8/10)', 

the  reflection  matrLx  R  =  {I  +  G)~^  becomes 

/  -310/27        16  \ 

~  \        20  -27  y  ■ 

Because  the  diagonal  elements  of  R  are  negative,  R  is  not  a  completely-5  matrix.  Hence  by 
Reiman  and  Williams  [28]  there  is  no  SRBM  W  associated  with  the  corresponding  reflection 
matrix  R.  Therefore,  W^  can  not  converge  to  an  SRBM  in  this  case.  n 

Proof  of  Corollary  3.1  For  x  G  D|^d[0,oo),  define 

/•oo 

J{x)=   /      e-"[J(j,ii)Al]  du, 
Jo 

where 

d 

J{x,u)=    sup   ^|j:,(0  -  ■c,(<-) 
It  follows  from  Lemma  4.2  that 


0<Ku;_j 


j(py")_0. 

almost  surely  as  n  —  oo.  Therefore,  by  Theorem  3.10.2  of  Ethier  and  Kurtz  [12],  any  limit 
W'  =  {W'it),t  >  0}  of  a  convergent  subsequence  of  {W''{-),n  >  1}  (under  the  Skorohod 
topology)  is  continuous.  From  the  proof  of  Theorem  3.1,  we  know  that  such  a  process  W  does 
not  exist.  Therefore,  {W^{},n  >  1}  cannot  be  D-tight.  D 
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6      Concluding  Remarks  and  Open  Problems 

In  this  paper,  we  have  proved  that  conventional  heavy  traffic  limit  theorems  do  not  hold  for 
general  multiclass  open  queueing  networks.  To  identify  a  maximal  subset  of  multiclass  networks 
such  that  the  corresponding  heavy  traffic  limit  theorems  prevail  seems  to  be  a  formidable  task 
for  the  moment.  We  conjecture  that  when  there  is  a  single  service  time  distribution  associated 
with  each  server,  the  convergence  in  (3.7)  holds. 

In  his  example,  VVhitt  [30]  demonstrated  that  the  non-convergence  of  the  normalized  work- 
load process  may  be  caused  by  large  fluctuations  of  the  workload.  In  [30],  these  large  fluctua- 
tions occur  because  batches  of  customers  with  short  service  times  build  up  in  the  queues.  One 
way  to  avoid  such  fluctuation  is  to  employ  some  kind  of  processor  sharing  discipline  (like  head- 
of-the-line  processor-sharing)  among  the  customer  classes  at  each  station.  It  is  worthwhile  to 
investigate  the  heavy  traffic  behavior  for  multiclass  queueing  networks  under  non-FIFO  queue- 
ing disciplines.  Research  in  this  direction  is  just  beginning,  see  the  appendix  to  Harrison  and 
Williams  [19]. 

Acknowledgment.  We  are  indebted  to  Ruth  Williams  for  commenting  on  an  earlier  version 
of  this  paper. 
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